Research on Energy-Saving Routing Technology Based on Deep Reinforcement Learning

نویسندگان

چکیده

With the vigorous development of Internet, network traffic data centers has exploded, and at same time, energy consumption also increased rapidly. Existing routing algorithms only realize optimization through Quality Service (QoS) Experience (QoE), which ignores center networks. Aiming this problem, paper proposes an Ee-Routing algorithm, is energy-saving algorithm based on deep reinforcement learning. First, our method takes performance plane in software-defined as joint goal establishes energy-efficient scheduling scheme for elephant flows mice flows. Then, we use Deep Deterministic Policy Gradient (DDPG), a learning framework, to achieve continuous goals. The training process Convolutional Neural Network (CNN), can effectively improve convergence efficiency algorithm. After converges, path weights are output, balanced completed. Finally, results show that good stability. Compared with DQN-EER improves saving percentage by 13.93%, compared EARS reduces delay 13.73%, increases throughput 10.91%, packet loss rate 13.51%.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

Research on Clustering Based Routing Energy-Saving Technology for Wireless Sensor Network

The clustering routing protocol for wireless sensor network (WSN) is the main part of this study. The number of sensor nodes in WSN is numerous and single node is extraordinarily limited in resource. The most significant aim of designing routing protocol of WSN is to reduce the overall energy dissipated in the network and to maximize the network lifetime. After taking into account the transmiss...

متن کامل

Reinforcement Learning with Deep Energy-Based Policies

We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new algorithm, called soft Q-learning, that expresses the optimal policy via a Boltzmann distribution. We use the recently proposed amortized Stein variational gradi...

متن کامل

Research on Energy Saving Potential for Dedicated Ventilation Systems Based on Heat Recovery Technology

Research results have identified the use of heat pipe heat exchangers (HPHXs) for heat recovery as a way to reduce the pre-cooling and re-heating energy. This paper suggests decoupling dehumidification from cooling to reduce energy consumption. The feasible usage and the energy saving potential of heat pipe heat exchanger at the air handler dedicated in accomplishing this objective is investiga...

متن کامل

On-line Building Energy Optimization using Deep Reinforcement Learning

Unprecedented high volumes of data are becoming available with the growth of the advanced metering infrastructure. These are expected to benefit planning and operation of the future power system, and to help the customers transition from a passive to an active role. In this paper, we explore for the first time in the smart grid context the benefits of using Deep Reinforcement Learning, a hybrid...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronics

سال: 2022

ISSN: ['2079-9292']

DOI: https://doi.org/10.3390/electronics11132035